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Abstract 

We study a condition of favoring cooperation in a Prisoner's Dilemma game on complex 
networks. There are two kinds of players: cooperators and defectors. Cooperators pay 
a benefit h to their neighbors at a cost c, whereas defectors only receive a benefit. The 
game is a death-birth process with weak selection. Although it has been widely thought 
that h/c > {k) is a condition of favoring cooperation we find that b/c > (/cnn) is 
the condition. We also show that among three representative networks, namely, regular, 
random, and scale-free, a regular network favors cooperation the most, whereas a scale- 
free network favors cooperation the least. In an ideal scale- free network, cooperation is 
never realized. Whether or not the scale-free network and network heterogeneity favor 
cooperation depends on the details of the game, although it is occasionally believed that 
these favor cooperation irrespective of the game structure. 

Keywords: Games, Cooperation, Prisoner's Dilemma, Networks, Analytical Solution 



1. Introduction 

Although a player incurs a lot of cost for cooperative behavior and being selfish is usually 
more beneficial than being cooperative as one player, cooperative behavior is ubiquitously 
observed in various forms of life system including even single cell. Cooperation is even the 
basis of life system, eco-system, and animal society including human being. Thereby, the 
research on how cooperation emerges and being enhanced have attracted much attention 
jij in game theory. To answer the question Prisoner's Dilemma game is often used, in 
which being defector is always better off than being cooperator and, however, both of the 
players being cooperators are always better off than both of them being defectors. This 
game structure reflects the situation of interest in reality. 

The seminal paper jsf introduced a spatial structure in the game theory and showed 
that a lattice structure enhanced cooperation in Prisoner's Dilemma game. Since then, it 
has been well recognized that the spatial structure is one factor affecting the emergence 
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of cooperation and thus a lot of effort has been made in this direction |4l -|l6l| . In contrast, 
cooperation is often inhibited by spatial structure in snow drift games [l7|. The spatial 
structure is regarded as a network. Many networks in reality are not often regular lattice; 
rather, they are often small-world; scale-free; or heterogenous heterogeneous networks. 
It has also been recognized that underlying network structures crucially determine an 
outcome of the models such as percolation, synchronization, epidemic spread, the Ising , 



voter, and a lot of other models [18|, Il9[ . Thereby, many researchers have expressed interest 
in games on such complex networks recently (see review j2o[) and explored especially how 
network structures such as the small-world characteristics, the scale-freeness, the network 



heterogeneity, and so on, affect the emergence of cooperation. For instance, Refs. [21 



23j showed that the scale-free network enhanced cooperation. Contrary to them, in the 
present paper we will conclude for the Prisoner's Dilemma model defined in section [2] that 
cooperation is inhibited by scale-free or heterogeneous network and enhanced by regular 
network, agreeing with Refs. js], |23 |. 

The review |2| entitled "Five rules for the evolution of cooperation" listed five mecha- 
nisms for the evolution of cooperation: kin selection, direct reciprocity, indirect reciprocity, 
network reciprocity, and group selection. We will show that the condition of favoring co- 
operation exactly corresponds to the network reciprocity of the five mechanisms. More 
specifically, the condition is h/c > (fcnn) for general uncorrelated networks (in which the 
degree and the nearest neighbor degree do not correlate), where b and c are the benefit 
and the cost of the Prisoner's Dilemma game, and (/cnn) is the mean degree of the nearest 
neighbors. Although many preceding researches are numerical simulations, we will analyt- 
ically derive the condition by using pair approximation and mean-field approximation in 
heterogenous networks. 

Previously, however, it was widely believed for the same model that the general condi- 
tion for favoring cooperation is 6/c > {k) [H (and reviews 

BH), where {k) is the mean 
degree. The point here is the difference between (/cnn) and (k). The difference is essential 



in network theory, producing interesting results in complex networks; see Refs. |25l-l27l|. It 
is not too much to say that owing to the difference network theory can exist. If a network 
has no degree-degree correlation, then (/Cnn) = (^^)/(^)- The probability that an end of a 
link is attached to a vertex with degree k, P^.^{k), is given by 



Pnn{k) 



7^ Ends attached to vertices with degree k 
7^ All the ends of links in the network 
NkP{k) 



where P{k) is the degree distribution. Therefore, we have 

(^nn) = ^ ] ^-Pnn(^) 



Ek' k'P{k') (k)- ^ ^ 
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The present paper is organized as follows. In section [2] we will explain the model. From 
section [3] to O we will derive the condition. In section [7] we will give an intuition why 
h/c > (/cnn) is the condition. In section |9] we will confirm the condition by numerical 
simulations. Finally, we will conclude in section [101 

2. Model 

Let us introduce the model. We consider two kinds of players: cooperators (C) and 
defectors (D). Cooperators pay a benefit h to their neighbors at a cost c, while defectors 
only receive the benefit. The game is a Prisoner's Dilemma (PD) game. The payoff matrix 
of the game is given by 



C D 




Figure 1: An example of the update rule of the game on a network. 

At each time step, a randomly selected player dies. The adjacent players compete for the 
empty vertex, occupying it with a probability proportional to their fitness defined below; 
this is called the death-birth process. There is another interpretation of an evolutionary 
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game (28(]. At each time step, an player is randomly chosen and updates his strategy by 
imitating his neighbors' strategy with a probability proportional to their payoff. We can 
thereby regard the model as a model of human behavior, which is called imitation dynamics 
in social sciences. 

The fitness of each player F is given by the sum of constant term, the baseline fitness 
1 — w and the payoff from the game P multiplied by w\ namely, F = 1 — w + wP. We 
set ^ 1, which is called weak selection. Then the probabilities of strategies change only 
slowly. 

In Fig. [H for example, the total payoff of cooperators around the randomly chosen 
shaded vertex is Fc = 2 — 2w + w{bh — 6c), while that of defectors is Fd = 2 — 2w + Swfe. 
The central randomly chosen player will be updated to a cooperator with the probability 
Fc/{.Fc + -^d) and to be a defector with the probability Fd/ {Fq + F-q). 

The update rule is a replicator dynamics extended to a network. If a network is com- 
plete, it is equivalent to a replicator dynamics: 

lp, = wpi{Pi-P), (4) 

where pi is the probability of strategy i, Pi is the mean payoff from the game of the player 
adopting strategy i, and P is the mean payoff from the game over all players. This is called 



replicator equation on graphs [29 



In the following, we explain the criterion whether a network favors cooperation or 
not. As the initial condition, we prepare a network in which all the vertices are occupied 
by defectors only. Next, we replace one of them by a single cooperator and run the 
evolutionary games until all the vertices are occupied either by only defectors, or by only 
cooperators. There are only two terminal states: one is that the whole network is occupied 
by cooperators only and the other is that it is occupied by defectors only. We iterate the 
same game a number of times and obtain the probability that only cooperators occupy the 
vertices. This probability is called the fixation probability pc [30|. If the selection neither 
favors nor opposes cooperation, the fixation probability pc is where N is the network 
size, because the density of the cooperators in the initial condition is If the fixation 

probability pc is larger than we say that the network structure favors cooperation, 
and vice versa. 

We want to know the dynamics of the probability of cooperators pc- However, we first 
study the more general problem of the following payoff matrix with strategy A and B: 




(5) 

A player is set on each vertex and plays games with its neighbors only. We consider 
a network without degree-degree correlations. We want to know the dynamics of the 
probability distribution of cooperators pc- However, we first study the problem of the 
general setting in Eq. ([5]), and then of the Prisoner's Dilemma game. Let N{k) denote the 
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number of vertices with degree k and let P{k) denote degree distribution. Let Pnn(^nn) 
denote the probabihty that an adjacent vertex has degree fcnn; -Pnn(fcnn) is the degree 
distribution of nearest neighbors, which is different from the degree distribution P{k). Let 
Px{k) denote t he p robabihty of strategy X on a vertex with degree k. We use the pair 



approximation [3lll- Let q'x|y(^nn, ^) denote the conditional probability of finding an X- 
player, given that the adjacent vertex is occupied by a F-player, and that the degrees of 
the X-player and the F-player are fcnn and k, respectively. For example, the probability 
that a randomly chosen vertex is a F-player with degree k and a next neighboring vertex 
is a X-player with degree k^n is Py (k) P {k)qx\Y {k^n, fc)-Pnn(fcnn) in pair approximation. 

We now provide the outline of derivation. We need to know the dynamics of pa, where 
Pa is the probability of strategy A in the whole network. For this purpose, we also need the 
dynamics of the conditional probabilities such as qA\A{krin, k) . As such, we first calculate 
pAik), and then calculate qA\A{krin, k) . Then, we calculate the fixation probability pa by 
a diffusion approximation. The terminal state of the probability pa is either 1 or only 
and the fixation probability of strategy A, pA, is the probability that pa reaches 1 in one 
game. At the final stage, we substitute the payoff matrix ([5]) with the Prisoner's Dilemma 
game ([3]), and then we have the condition of favoring cooperation b/c> {k^n}- 

We will follow the derivation of Ref. [H. The difference is that we consider the het- 
erogeneity of degree distribution explicitly. Therefore, a probability of strategy and a 
conditional probability depend on the degree k and nearest neighbor degree k^n, so that 
we write them as px{k) and q'x|y(^nn, ^) as defined above. In addition, in order to deal 
with a heterogenous network we use a mean-field approximation for network structure 
that we will explain in the following. As a result of the mean-field approximation we will 
have two kinds of the probability of strategy px and p^?? and two kinds of the conditional 
probability qx\Y and q^^y- '^^^ definitions will be given below. 

In the mean-field approximation for a heterogenous network structure, the degree of a 
vertex adjacent to any randomly chosen vertex is replaced by the mean degree of nearest 
neighbors (fcnn) as illustrated in Fig. M^a). Subsequently, a vertex with degree (/cnn) is 
also surrounded by vertices with degree (/Cnn) as illustrated in Fig. Mjo)- Further, a degree 
of any randomly chosen vertex is replaced by the mean degree (k). Thus, in the mean- 
field approximation the probability of strategy A on a randomly chosen vertex is given by 
PA{{k)), and the probability of strategy A on a neighbor of a randomly chosen vertex is 
given by PAi{knn))- 



3. Dynamics of probability of strategy 

First, we study the case where a 5-player with degree k is randomly chosen with 
probability pB{k)P{k) and changes the strategy from B to A, and consequently pa increases 
by 1/N{k). Because we need pA{{k)) and pA((^nn)), we compute PA^k) first and then 
substitute (k) and (knn) later on. 

Let kA and ks denote the number of A-players and -B-players in the neighborhood 
of that randomly chosen 5-player. As such, kA + ks = k. Because of the mean- field 
approximation we replace the degree of any neighboring vertex by (/cnn)? and the degrees 
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Figure 2: : Mean-Field approximation, (a) A vertex with an arbitrary degree k is surrounded by vertices 
with degree (knn)- (b) A neighboring vertex with degree (knn) is also surrounded by vertices with degree 

(^nn) ■ 



of A-players and 5-players around the randomly chosen 5-player by both (/Cnn)- We define 
q'^^Y = Qx\Y{{knn), (^nn))- Degrees of neighboring vertices of the neighbors of any randomly 
chosen vertex are (/Cnn) as illustrated in Fig. Mjo)- Thus, for example, the probability that 
a neighbor of an A-player neighboring to the randomly chosen vertex is a i?-player is given 
by qB\A{.{knn), (^nn)) = Qbia' Therefore, the expected fitness of A-players and 5-players 
adjacent to the chosen i?-player, /a and fs, respectively, are given by 

fA = l-w + w [{{K,,) - + {{{K^) - + l}y] , (6) 

fB = l-w + w [{{K,,) - + {{{K,,) - + l}s\ . (7) 

The probability that the randomly chosen 5-player changes the strategy from i? to A is 
then given by 

kAfA 



kAfA + ksfs 



The probability that a randomly chosen 5-player has kA A-players and ks -B-players in 
the neighborhood is given by 

Yl 'kjk^l (^^l-B((^nn), k)f^ {qB\B{{knn) , k)f^ . (9) 

Therefore, the probability that a 5-player is randomly chosen and changes the strategy 
from B to A, and consequently PA{k) increases by 1/N{k) is given by 

Pr UpA{k) = ^) =PB{k)P{k) Yl rWl. i<lM{k^n),k)f-' {qBlB{{k^n),k)f- 
^ ^ kA+kB=k ^' ^' 

kAjA + kBjB 

Next, we consider the case where an A-player is randomly chosen and then the A-player 
changes the strategy from A to B, and consequently PA{k) decreases by 1/N{k). 
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The probability that an A-player with degree k is chosen is pA{k)P{k). Suppose that 
around the randomly chosen A-player, there are /c^ A-players and ks -B-players and the 
probability that such a configuration occurs is given by 

jriri {U\Ai{knn),k)f^ {qB\Ai{knn),k)f^ (11) 

The expected fitness of A-players and 5-players adjacent to the randomly chosen A-player, 
gA and qb, respectively, are given by 

= 1 _ ^ + ^ [{((A;,^^) _ l)gnn^ + l}^ + ((A;,^^) _ 1)^-^^] , (12) 

gB = l-w + w - l)g^s + 1}^ + ((A;„„) - l)^-;^^] . (13) 

Thus the probability that the randomly chosen A-player changes strategy from A to -B is 
given by 



kAgA + ksgB 



Therefore, the probability that an A-player is randomly chosen to update the strategy 
and then changes the strategy from Aio and consequently the probability of strategy 
A with degree k decreases by 1/N{k) is given by 

Pr (^^PA{k) = =PA{k)P{k) Yl ^))'" imA{{Kn),k))'- 

kAQA + ksgB 

Combining Eqs. f lTOj) and f lTSj) . we have 

Because the degree of any randomly chosen vertex is (k), thus the probability of strategy 
A in the network is PA{{k)) in the mean-field approximation. Thus we have 

^„ 1 \^ \k,t^ NfcB (^)' ^aIa 



kA+kB = {k} 
kA+kB = {k) 

Recall that qx\Y = gx|y((^nn), {k))- 
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We also need to have E [Ap^], where = Px{{knn)) is the probabihty of strategy A 
in the neighborhood of a randomly chosen player. Substituting (fcnn) with k of Eq. ( !T6|l . 
we have 

^„nn_ 1 p//, \\ nn / nn NfcAf„nn Nfeg (^nn)! ^a/a 

-iV((0) ""^^"^^ /'^'^^ ^'^'^^ MA:b!Wa + Wb 

The fact that the set of equations is closed here is due to the mean-field approximation. 



4. Dynamics of conditional probability 

We then go on to the dynamics of conditional probabilities qA\A and g^"^. We again 
use the mean-field approximation, replacing degree of any randomly chosen vertex by 
(k) and that of any adjacent vertex by (/cnn)- First, we study the dynamics of qA\A = 

qA\Ai{knn), (k)). 

We now study the case where qA\A increases. For this purpose, suppose that a B- 
player is randomly chosen and then changes the strategy from B to A. Suppose that the 
randomly chosen 5-player is linked to kA A-players and ks -B-players. The probability 
that the 5-player with this configuration is chosen is given by 

PBP{{k))^^{qAiBrHmB)'''- (19) 

The probability that the randomly chosen 5-player changes the strategy from S to A is 
given by 

kAfA ^20) 



kAfA + ksfs 

After the i?-player changes the strategy, the conditional probabihty qA\A increases by 

PA{{k),t)qA\A{{knn), {k))N{{k)){k)Pn^{{kn^)) + kA 



p^((A;),t + At)iV((A;))(A;)P„,((A;„n)) 



qA\A{{knn)Ak)), (21) 



because conditional probability ^^[^(^nn, ^) is given by the number of linked pairs of an 
A-player with degree (/cnn) and an A-player with degree k divided by the number of linked 
pairs of an A-player with degree k and a player of any strategy with degree (k^n)- Using 
the fact that pa changes of order 0{w), which will be confirmed later, the above equation 
becomes 

+Oiw). (22) 



PAN{{k)){k) 
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Next, we are going to study the case where qA\A decreases. Suppose that an A-player is 
randomly chosen and the A-player has A-players and ks -B-players in the neighborhood. 
The probabihty that the A-player with such a configuration is chosen is 

PAPm)^^{u\Af^{qB\Af-. (23) 
The probabihty that the A-player changes the strategy from A to i? is 

, '!f! . (24) 

kAQA + kBQB 

After the A-player changes the strategy, the conditional probability qA\A decreases by 
Therefore, we have 

^-luxPAy^i^yy^n kAikBi kAjA + kBiB 

u ,T^-,i.xPMk}N{{k}) kA\kB\ kAQA + kBQB 

+ 0{w), (26) 

Analogously, we will compute -^[^^1^], where g™^ = qA\A{{knn), {knn))- 



5Z ^nn/L \NPr^((M)7-fr-y(gAt4)^^(g^A)^''- 



,Pr(OA^((fcn„))"^ ^™^A;a!A;b!^'^'^^ ^'^'^^ kA9A + kBgB 
+ 0{w). (27) 



The derivation is given in detail in [Appendix A 



5. The System of Equations 

We now simplify the master equations in Eqs. ( |T7|) . ( IT8|) . ( 126|) . and ( 127|) . Transforming 
j^A in Eq. ( !T7|) . we have 

d (A;) — 1 2n 

= (-^^^ + -^''2/ - -^2^ - -^ss) w + 0[w ), (28) 
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(29) 



where 

h = {{Kn) - l)q''A\A{(lA\A + qB\B) + qA\A, 
ly = {{knn) " l)gB^(gA|A + QbIb) + qB\B, 
Iz = {{knn) - ^)qT\B{QA\A + qB\B) + qA\A, 
h = {{knn) - l)qB'\B{QA\A + qB\B) + qB\B, 

while the conditional probability qA\A in Eq. ( l26l) is transformed to 

^?A|A = J^^ff~PAB [1 + {{k) - l){qA\B - qA\A}\ + 0{w). (30) 



We confirmed that pA is of order 0(w), whereas qA\A is of order 0{w^). To derive Eq. ( 128|) . 
we used the mean-field relation 

qx\YPY = PxY = Pyx = qY\xPx; (31) 



the reason why it holds is discussed in Appendix B Owing to this relation the 0{w^) 
terms in Eq. ( l28l) vanish. 

Equations ( IT8|) and ( 127|) lead to 

^pT = i^^P^B {iT^ + iTv - iTz - ITs) w + 0{w\ (32) 



where 



IT = {{k.n) - l)q7\A{qA\A + <1b\b) + 
= ((A:„,) - l)g^^(g^t4 + 1m) + 'Zbib, 

/r = {{knn) - l)q7\B{q7\A + ^^i.) + q7\A. 
IT ^ {{knn) - l)qB\B{qA\A + ^bIb) + 



(33) 



and 



j^q7\a = (fc,„)^iVp^n PAB [1 + ((A:n„) - l){q7\B - 9aIa}] + «(«;). (34) 

We thus confirmed that "PT is of order 0{w) and g^^^ is of order 0{w^). To derive Eq. ( 132|) . 
we used the relation Q'^lyP?? = PxY = qY\xP7- Owing to this relation the 0{w^) terms in 
Eq. ([32]) vanish. 

We now have the following system of equations: 

Pa = Fi{pA, qA\A, ^a^a)^ + 0{w^), 
p7 = F2{p7,qT\A> + 0{w% 

(35) 

gA|A = F^{PA, gA|A, ^aIa) +0{w), 

Q7A = F,{p7,q7A) + 0{w), 
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where the functions Fi are defined in Eqs. (!28|) . ( 132|) . (130|) . and (!34|) . The equations 
of p and p""^ are of order 0{w), whereas the equations of qA\A and of g^^^ are of order 
0{w^). Because ^ 1 meaning weak selection, the conditional probabilities qA\A and 
g™^ converge to stationary values much faster than and do. Thus the system very 
quickly converges to the slow manifold given by F3 = and F4 = 0. Therefore, we assume 
that the following equations always hold: 

l + [{k)-l){qA\B-qA\A} = ^, 

i + ((o-i)MtB-g:^i^} = o. ^ ^ 

Because the relations concerning the strategy pair, qx\Y'PY = Vxy = 1y\x'Px and 
Qjc\yPy' — PxY = QyixPx"^ hold, the probabihties of strategies Pa,Pb, Pa^, and and 
the conditional probabilities qA\A,QB\A, Qb\b,(1a\b, 1a\a^1b\a^ 1b\b^ 1a\b 
pressed in terms of PAyPA^y Qa\a, and q^^- Further, using Eqs. (136|1 . we can express the 
conditional probabilities in terms of pa and In other words, only pa and p^ are 

sufficient to express the other probabilities and conditional probabilities. 



6. The condition of favoring cooperation 

Remember that our concern is the dynamics of pa- We now approximate the dynamics 
of as a diffusion process 32|,|33|]. Eliminating the conditional probabilities from Eqs. fl36|l 
and using Eqs. ffTOl [T5l) . we have the expectation value of ApA and the variance of ApA as 
follows: 

E[Apa] =^7^ Pr [ApA = -TTT^] - -TT^ Pr ( ApA ^ 



Nm) V " N{{k))J N{{k)) V " Nm) 
(k) — 2 

-MPA)At, (37) 



1 V 



2(W-2) 



2 



((fc) - l)iViV((A:)) 



PA{l-pA)At = v{pA)At, (3J 



where 



a = (x - y - z + - 2), (39) 
(3 = (x-y-z + s){k){{k^,,)-2), (40) 
7 = (x-y- 2; + s) + (x -!/)(/;;) + (A;) (A;nn)(y-s). (41) 

The dynamics of pa is approximated by the diffusion process with the drift m{pA) and the 
variance v{pa) for unit time step At. 
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The fixation probability of strategy A, pA{f^)i for the initial probabihty 
PAii = 0) = r, satisfies the following differential equation: 

Now, we use the Prisoner's Dilemma pay-off matrix given by 

C D 
C fb-c -c 

b[ b 



The differential equation P2l) becomes 



(43) 



0.,_,.„,K,^!^._i^f!!^. ,44) 

Since w <^ 1, pc(l) = Ij and pc(0) = 0, we have the solution of Eq. (H^ in the form 

PcW ~r + u;^^^^(6-c(fc„n))r(l-r). (45) 

As we discussed in section [2], the criterion that a network favors cooperation is pq{1/N) > 
1/N. Therefore, we have 

^ > (A:nn). (46) 
This is the condition that a network favors cooperation. 



7. Intuition: Why is b/c > (fcnn) the condition? 

We present intuitive reasoning of why the condition for favoring cooperation is 6/c > 
(fcnn)- The point is that the mean degree of players competing for the vacant vertex is 
(fcnn)- In the mean-field picture, any vertex is surrounded by vertices with degree (/cnn), as 
illustrated in Fig. |3l 

After we transform the second equation of Eq. (l36l) . replacing A by C and B by D, and 
using = 1 — gj^^j^ obtained from = 0, the equation becomes 

((^nn) - l)gS|^ = i{Kn) ' l)Pc + Pd, (47) 

{{K^) - l)ql^^ = {{K^) - l)p^- - (48) 
Subtracting the second equation from the first one, we have 

((A:,,)-l)(gS]^c-?S|D) = l- (49) 
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Figure 3: In the mean-field approximation for a network structure, the degrees of vertices adjacent to any 
vertex are (knn)- 




Figure 4: A C-player and a D-player compete for a vacant vertex V. The degree of the vacant vertex is 
arbitrary. The mean degrees of the C-player and the D-player are both (/cnn)- 
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Now, suppose that a C-player and a D-player compete for a vacant vertex V as illus- 
trated in Fig. m Because the payoff matrix of the Prisoner's Dilemma game is given by 
Eq. ( I43l) . the expected payoff from the game for a C-player, G^, and that of a D-player, 
are respectively, given by 



Gnn 
D 



(b - c)q^U(^nn) - 1) - Cg^c((fcnn) - 1) + Wy,C 



65- 



(50) 
(51) 



where V is either C or D. If Gq^ 



G"^^ > holds, the network favors cooperation. Using 



{{K^} - l)(g°'^c - 1c\d) = h and g-^^ = 1 " ?STc in Eq. m, we have 



which yields 



> (^nn)- 



(52) 



Thus, if the condition b/c> {k^n) is satisfied, cooperators are favored in the network. 

In other words, we see from Eq. (149|) that the C-neighbors of the vacant vertex V have, 
on average, one more C neighbor among their (/Cnn) other neighbors than the D-neighbors 
of V do. This extra benefit b must outweigh the cost c(/Cnn) incurred by the C-neighbors 
of V. Thus we must have b/c> (k^n)- In the example illustrated in Fig. El the C-neighbor 
of the vacant vertex V has three cooperators as the neighbors, while the D-neighbor has 
two cooperators. The payoff from the game of the cooperator, Gc = 3b — c(/cnn), must 
outweigh that of the defector, Gb = 2b. Thus, we have the condition fH6l) . 




Figure 5: The C-neighbor has, on average, one more cooperator among their (fcnn) 
D-neighbor docs. 



1 neighbors than the 
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8. Which networks favor cooperation the most and the least 



Because our condition h/c > (/Cnn) depends on (fcnn), we can see which of the three 
representative networks, regular, random, and scale-free, favors cooperation the most and 
the least. For this comparison purposes, we fix {k){= fi) for the three networks. Even 
though {k) is the same, (fcnn) can be different. 

In general, we have 



(k) 



(53) 



where cr^ is the variance of the degree distribution. For a regular network, (A^nn)'^'^^"'^'^ = ^^ 
since cr^ = 0. The degree distribution of a random network is Poisson. Because the mean 
and the variance of Poisson distribution are the same, we have {kjia)^^^'^°^ = (A;) + 1 for 
a random network. Therefore, (/cnn)'^'^^"^'^'^ < (/Cnn)'^^'^'^"™- A scale-free network is a network 
in which the degree distribution P{k) follows P{k) ~ k~^ typically with 2 < 7 < 3. The 
mean degree of the nearest neighbors of a scale-free network of infinite size is 



(A^nn) 



scale- free 



{k) 



k'^-^dk 



00 



for 2 < 7 < 3. Thus, the inequality (/^nn)'"^"'^'' < {h^nY'"'"^'''^ < (/^nn)'"^^""^'''" holds for 
almost all the cases of interest. 

Among the three network classes, a regular network favors cooperation the most and 
a scale- free network favors it the least. In an ideal scale- free network of infinite size and 
with 2 < 7 < 3, cooperation is unfeasible because {k-^^.^^'^^^^'^'^^^ is infinite. Because of 
Eq. ( 153|) . the network heterogeneity increases (/cnn)- In other words, a heterogenous network 
suppresses cooperation. The feature that the scale-free network suppresses cooperation is 



seen in the numerical simulations in Ref. [l[ and also agrees with Ref. [2J]. However 



Refs. [2l|-|23| claim that the scale-free network and the heterogenous network conversely 
favors cooperation. This is probably because the rule of the games are different. Whether 
or not the scale-free network and the heterogenous network favor cooperation depends on 
the details of the game, although it is occasionally believed that these favor cooperation 
irrespective of the rule of a game. 



9. Simulations 

In the following, we show numerically that the condition ( H^ holds well, verifying our 
approximations. We simulate the game on several networks with h/c set to different values. 
The random networks are Erdos-Reyni random networks [i^] . The scale- free networks are 



made by a preferential attachment mechanism [35|, l36|. In Fig. [6] and Fig. [TJ the x axis 
indicates 6/c, while the y axis does the fixation probability. The horizontal straight line 
corresponds to the neutral probability given by If a point is above the horizontal 

line, the network favors cooperation by definition; if the point is below the horizontal line. 
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Figure 6: Results of numerical simulations for random networks. The horizontal straight line is the 
neutral probability The x axis indicates hjc while the y axis indicates the fixation probability. The 

vertical broken line indicates the points where hjc = (fcnn)- (a')~(c) (fc) = 6,10,14, the network size 
TV = 600, 600, 700, and w = 5 x lO'^, 7 x 10"^, 4 x 10-^ respectively. 
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Figure 7: Results for numerical simulations of scale-free networks, (d)-(f) N = 600, w = 10 7 = 7.5, 
and (/c) = 6, 10, 16, 20, respectively. 
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the network suppresses cooperation. The vertical broken hne indicates the point where 
h/c= (k^n)- Our condition holds exactly if a point falls onto the crossing of the horizontal 
and vertical lines. Figure |6] and Fig. [7] show that for both random and scale- free networks, 
our condition holds well. 

We constructed the scale-free networks in the following way. First, we prepare a com- 
plete network consisting of K vertices, in which all the vertices are connected to each other. 
Next, a new vertex with m links enters into the existing network. The probability that the 
new vertex is connected to an existing vertex i is ^^/."'"^ where kj is the degree of vertex 

i. Next, another new vertex enters the exiting network in the same way. After repeating 
this process, we have a scale-free network. As gets large enough the exponent 7 of the 
degree distribution of the scale- free network asymptotically converges to 7 = 3 + A/m. In 
the simulation, we use m = {k)/2, K = m + 1, A^ = 600, and A is such that 3 + A/m = 7.5, 
so that the exponent 7 is 7.5. 
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Figure 8: Comparison between random networks and scale- free networks. The random network is indicated 
by circles; the scale-free network is indicated by crosses. The parameters are common: (fc) = 10, = 600, 
and w = lO^'^ for both networks. The exponent of scale-free network 7 is 7.5. The y axis indicates the 
fixation probability; the x axis indicates b/c. 

In Fig. [8], we compare the random and the scale-free networks. The network size 
A^, w, and the mean degree (k) are taken to be the same. The comparison shows that 
random networks favor cooperation more than scale-free networks do, because the fixation 
probabilities for random networks are greater for all the points. 
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10. Conclusion 



We study the Prisoner's Dilemma game where the payoff matrix is given by 



C D 

C fb-c -c 
B\ b 



) 



(54) 



and analytically derive the condition of favoring cooperation for uncorrelated networks. 
The game is done under a death-birth process with weak selection. In summary, we 
obtained the following four results. 

(i) Although it has been widely thought that b/c > (k) is the condition of favoring 
cooperation, we show that b/c> (/cnn) is the condition. The mean degree of players com- 
peting for a vacant vertex is (/cnn) and the fitness of these adjacent players are determined 
by {knn)', then, (k^n) determines the outcome. 

(ii) We show that among three representative networks, regular, random, and scale-free, 
a regular network favors cooperation the most and a scale-free network the least. This is 
because the condition depends on the mean degree of nearest neighbors, (fcnn)- Whereas 
the scale-free network has the largest mean degree of nearest neighbors, the regular network 
has the least for the same value of the mean degree (k) . 

(iii) In an ideal typical scale-free network characterized by the infinite number of vertices 
with 7 < 3, cooperation is unfeasible. 

(iv) Although the scale-free network and the heterogeneous network favor cooperation 
in some cases, they suppress cooperation in our case. The scale-free network does not 
always favor cooperation irrespective of the game structure, although some occasionally 
believe so. Whether the scale-free network enhances or diminishes cooperation depends on 
details of the game. 
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Appendix A. The derivation of E[/\q^j^] 

In the present appendix, we derive E[Aq^^] in Eq. fl27jl . First, we are going to study 
the case where increases. Suppose that a 5-player with degree (k^n) that is linked to 
kA v4-players and ks -B-players in the neighborhood is randomly chosen. The probability 
that an A-player is chosen is given by 




Tin/ ^nn fc^ nn kg 



(A.l) 
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Figure A. 9: Pairs of an A-playcr and a _B-playcr in two situations. 



where p^? = Px{{knn))- The probabihty that the chosen i?-player changes the strategy 
from S to A is 



^^^^ (A.2) 



kAfA + ksfs' 



If the 5-player changes the strategy from B to A, the conditional probabihty q^j^ increases 

by 

+0{w), (A.3) 



p'^N{{knn)){knn) 

where we have used the fact that changes only of order w, which will be confirmed 
later. 

Note the factor 2 in the numerator of Eq. (1A.3I) . We are going to explain the reason of 
the factor in Fig. IA.9I The conditional probability increases when a 5-player on the vertex 
1 changes the strategy from B to A and the player is linked to an A-player on the vertex 
2. The point is that when both of the degrees of the vertex 1 and the vertex 2 are (/^nn); 
the factor 2 appears. Let Al denote the strategy A of the vertex 1 and A2 that of the 
vertex 2. Thus, both of the pairs A1-A2 and A2-A1 resulting from the change of strategy 
contribute to the increase in the conditional probability; one is seen from the vertex 1 and 
the other is seen from the vertex 2. When the vertex 1 was a -B-player, on the other hand, 
the pair was Bl-Al. In the case of qA\A{{knn) , (k)), from the assumption that a randomly 
chosen vertex has the degree (k) and the vertices adjacent to the randomly chosen one has 
the degree (/cnn) the conditional probability would increase in one way seen from the vertex 
with the degree (k) in Eq. (l25l) . 

Suppose that the vertex 1 changes the strategy from B to A; then the pairs of k and 
(fcnn) increases by one. On the other hand, suppose that the vertex 3 changes the strategy 
from B to A; then the pairs of (k^n) and (/cnn) increases by two. One is seen from the 
vertex 3 to 4 and the other is seen from the vertex 4 to 3. 

Next, we are going to study the case where decreases. Suppose that an A-player 
with degree (fcnn) linked to kA A-players and ks -B-players in the neighborhood is randomly 
chosen to update the strategy. The probability that it happens is given by 

PTPiiknn) ) (ql^A)'^ {qB\Af^ • (A.4) 
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The probability that the randomly chosen A-player changes strategy from A to i? is 



, ^^^f ■ (A.5) 

If the A-player changes the strategy from A to B, then the conditional probability q^^\^ 
increases by 

Oh A 

0{w). (A.6) 



PT^((^nn))(/Cnn) 

We thus have Eq. (1271) : 



„nno//L \N (^nn)! / nn \kA f^nn \kFi ksQE 



5Z .nn/r. ^^PTP{{knn))T:^{q7iA)''■HQmA) 



, ,, „ ,PT{knn)N{{knn)) kA^ksl ' ' kAQA + ksgB 

+ 0{w). (A.7) 



Appendix B. The reason QxiyPy = Pxr = Pyx = holds 

In the present appendix, we argue the relation fl3Tl) . The point is that in the mean- field 
approximation the degree of any randomly chosen vertex is {k), that of any neighboring 
degree is {k^n), and that of a vertex attached to a randomly chosen link is also (/cnn)- 
Note also that qx\Y is the conditional probability between randomly chosen vertex and 
its neighbor, and q^^y conditional probability between vertices on both ends of a 

randomly chosen link. 

Pair probabilities are computed by two methods. In one method, we first choose a 
vertex randomly and check the strategy X of the vertex. Then, we check the strategies of 
all vertices linked to the chosen vertex. The conditional probability of finding a strategy 
Y on another vertex is qY\x- This procedure is carried out iteratively for all N vertices. 
Because every link is connected to two vertices and every pair is counted twice, in this 
method, we count 2L pairs in total, where L denotes the number of links in the network. 
The pair probabilities computed by this method let us understand the relation qx\YPY = 
PxY = qY\xPx- 

In the other method of computing pair probability, we first choose a link and check the 
strategies of vertices of both ends of the chosen link. The probability of finding a strategy 
X on one end is p^, and the conditional probability of finding a strategy Y on the other 
end given that the strategy X is already found is q^^x- Then, we carry out this procedure 
iteratively for all L links. In this method, we count L pairs in total. The pair probabilities 
computed by this method let us understand the relation g^fjyPy^ = Pxy = qY\xP3c- Because 
of the mean-field relation qx\YPY = Pxy = qY\xPx, the 0{w'^) term in Eq. (1251) vanishes. 
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We also give another explanation of the relation qx\YPY = Qy\xPx- The pair probability 
PxY is given by 



# of XY pairs 

VXY = 



^ of Links 



N{k) 

and the pair probability prx is given by 

^ of YX pairs 



(B.l) 



Pyx 



^ of Links 

T.knn,k(lY\x{knn^k)P{knn\k)kNp{k)px{k) 



N{k) 

Further, the relation pxY = Pyx holds. Therefore, the following equation holds: 

Efc„„,fc (lX\Y{knn, k)P{knn\k)kNp{k)pY{k) 



(B.2) 



PXY (B.3) 



J2k^,,,kQY\x{knn,k)P{k^r.\k)kNp{k)px{k) 

= = m • ^^-'^ 

Because of the mean-field approximation we replace the degree of nearest neighbors k^^ by 
(fcnn) and the degree k by (k): 

<lx\Y{k^n, k)P{kr,n, k)p{k)pY{k)kN 

= WW) ^""-'^ 

qx\YPYN{k) 

- = QxiyPy- (B.6) 



N{k) 

Therefore, pxY = (1x\yPy holds in the mean-field approximation. Similarly, pyx = (1y\xPx 
holds. Thus, qY\xPx = Pyx = Pxy = QxiyPy holds in the mean-field approximation. 
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